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Introduction: 


This  project  is  funded  in  order  to  conduct  a  multicenter,  randomized  controlled  trial  to  determine 
whether  early  ICU  rehabilitation,  for  Burn  Intensive  Care  Unit  (BICU)  patients,  will  decrease 
hospital  length  of  stay.  Fifty  subjects  will  be  randomized  at  each  of  three  sites  for  a  total  of  150 
subjects.  Study  start-up  was  initiated  in  Year  #1  and  all  sites  are  now  enrolling  patients.  Sixteen 
study  subjects  have  been  enrolled.  Out-patient  visits  during  the  post-enrollment,  post-hospital 
discharge  phase  of  the  study  have  begun  and  outpatient  phase  of  testing  has  been  conducted. 
As  well,  phone  follow-ups  at  the  end  of  second  and  third  years  post-enrollment,  remain  planned. 
The  sites  are  now  committed  to  increasing  enrollment  goals  above  planned  -  and  will  average 
of  2.5  patients  enrolled  per  month,  per  site;  7.5  patients  enrolled  per  month  or  greater,  across 
the  study,  to  compensate  for  the  time  spent  on  regulatory  work  prior  to  initiation  of  subject 
enrollment. 

This  study  will  proceed  and  allow  for  greater  understanding  of  the  effect  of  rehabilitation  on  the 
pathophysiology  of  ICU  Burn  patients.  Through  ultrasound  and  strength  assessments  of 
muscles,  performed  at  study  entry  (ultrasound),  ICU  &  Hospital  discharge  and  at  3,  6  and  12 
months  post-enrollment,  the  study  will  determine  if  Standardized  Rehabilitation  Therapy  (SRT) 
decreases  loss  of  bicep  and  quadricep  muscle  mass,  architecture  change  and  prevents  strength 
loss.  The  protocol  contains  functional  testing  with  the  Short  Physical  Performance  Battery 
(SPPB)  and  Health  Related  Quality  of  Life  (HRQoL)  testing  with  SF-36  and  Burn  Specific  Health 
Scale  (BSHS-B).  These  tools  will  be  administered  to  determine  if  SRT  improves  functional 
performance,  quality  of  life  and  employment  status. 

Keywords: 
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Overall  Project  Summary: 

Monthly  study  conferences  have  been  active  with  discussion  across  Pi’s  and  coordinators. 
These  conferences  have  led  to  recommendations  to  address  the  gap  between  targeted  and 
actual  enrollment  volume  within  the  study.  These  conversations  were  detailed  and  examined 
possibilities  at  each  site  to  identify  improvements  in  process.  Additionally  and  more  importantly, 
it  was  noted  that  the  burn  population  at  these  sites  were  in  receipt  of  pre-hospital  management 
that  had  changed  since  the  original  proposal.  The  Pi's  then  elected  to  put  into  action  a  plan  that 
would  increase  enrollment  by  recognizing  this  factor  of  pre-hospital  burn  patient  management 
and  have  now  addressed  this  practice  more  appropriately  within  the  inclusion  criteria.  Changing 
the  inclusion  criteria  to  eliminate  mechanical  ventilation  as  the  key  criterion,  has  allowed  focus 
on  the  severity  of  the  burn  &  its  sequelae.  The  change  has  been  reviewed  within  the  PI  group, 
local  IRBs  and  the  HRPO  and  will  not  materially  alter  the  study  other  than  to  increase 
enrollment.  Given  that  pre-hospital  procedural  changes  throughout  the  US  have  occurred  with 
respect  to  intubation  over  the  past  few  years,  resulting  in  fewer  intubated  patients  arriving  in 
EDs,  intubation  status  is  now  not  a  significant  indicator  of  burn  severity.  Burn  size,  which 
determines  ICU  admission,  is  the  key  determinant  for  burn  severity.  Thus,  being  able  to  enroll 
any  patient  warranting  Burn  ICU  admission  will  allow  us  to  focus  on  the  severely  burned  patient 
&  demonstrate  the  benefits  of  early  aggressive  ICU  rehab,  which  has  yet  to  be  demonstrated  in 
the  peer-reviewed  literature. 


Patient  screening  and  patient  enrollment: 

Patient  screening  commenced  and  has  been  ongoing  at  all  three  sites.  Through  August  2014, 
345  individuals  have  been  screened  for  this  study  since  May,  2013. 


Patient  review: 


To  date,  sixteen  study  subjects  have  been  enrolled.  Appropriate  timelines  were  adhered  to  in 
regards  to  study  enrollment  windows.  Appropriate  execution  of  study  inclusion  and  exclusion 
rules  was  conducted.  Each  study  subject  had  an  appropriate  study  IRB  consent  form,  with 
appropriate  dated  signatures,  obtained  prior  to  randomization.  Randomization  procedures  were 
engaged  and  functioned  without  difficulty. 

To  date  both  study  arms  have  been  engaged  with  study  subjects.  Standardized  rehabilitation 
therapy  and  usual  care  were  delivered  to  study  subjects.  Success  was  achieved  in  the  delivery 
of  multiple  intervention  arm  rehabilitation  sessions  including  delivery  of  resistance  training 
exercise  with  Therabands.  Blinded  exercise  physiologists  have  conducted  the  strength  and 
functional  assessments  according  to  protocol. 

Our  publications  have  targeted  the  study’s  standardization  of  ultrasound  images  of  muscles  in 
an  ICU  population. 


Key  Research  Accomplishments: 

•  All  IRB  and  HRPO  obligations  have  been  met 

•  All  subcontract  sites  have  working  relationships  with  Wake  Forest  to  receive  study 
payments 

•  Electronic  secure  remote  entry  database  is  functioning 

•  Ultrasound  muscle  imaging  protocol  has  been  completed  allowing  for  standardized 
images  across  sites 

•  Study  screening  is  ongoing 

•  Study  subject  enrollment  and  randomization  is  ongoing 

•  Intervention  sessions  are  being  delivered  according  to  protocol 

•  Ultrasound  images  are  being  obtained 

•  Strength  and  Functional  Assessments  are  being  obtained 

•  Plans  for  augmentation  of  study  subject  enrollment  has  been  discussed  by  investigators 
with  recognition  of  need  to  surpass  initial  proposed  enrollment  timelines  for  timely  study 
completion 


Conclusion: 

To  date,  the  investigators  conclude  that  the  work  performed  will  allow  the  study  hypotheses  to 
be  tested  sufficiently.  Current  hypotheses  are  that  standardizing  rehabilitation  for  Intensive  Care 
Unit  Burn  patients  will: 

1)  shorten  hospital  length  of  stay  in  burn  patients. 


3)  improve  objective  strength,  functional  measures,  and  quality  of  life  at  3,  6,  12,  24,  and 
36  months  post-enrollment. 


The  investigators  conclude  that  the  systems  built  and  implemented  for  this  study  will  allow  for 
the  conduct  of  a  multicenter,  randomized  controlled  trial  which  will  determine  whether  early  ICU, 
standardized  rehabilitation  therapy  for  BICU  with  blinded  strength  assessments  decreases 
hospital  length  of  stay.  Fifty  (50)  subjects  will  be  randomized  at  each  of  three  sites,  for  a  total  of 
150  subjects. 

Although  study  startup  was  prolonged,  subject  enrollment  is  now  active.  Enrolment  criteria 
have  been  adjusted  to  better  optimize  the  volume  of  screened  patients  who  become  enrolled. 
Sixteen  study  patients  have  been  enrolled.  The  study  subjects  will  receive  three  in-person 
visits  during  the  1  st  year  post-enrollment  and  will  be  followed  by  phone  follow-up  at  end  of  2nd 
and  3rd  years  post-enrollment.  Enrollment  strategies  will  be  engaged  to  enhance  the  initial 
grant's  proposal  of  2.5  patients  enrolled  per  month,  per  site;  7.5  patients  enrolled  per  month, 
across  the  study. 

Ultrasound  and  strength  assessments  of  muscles  have  been  successfully  performed  at  study 
entry,  ICU  &  Hospital  discharge.  These  will  continue  at  3,  6  and  12  months  post-enrollment. 
These  observations  will  be  critical  for  the  study  to  determine  if  standardized  rehabilitation 
therapy  decreases  loss  of  biceps  and  quadriceps  size,  architecture  change  and  blunts  strength 
loss. 

Lastly,  performance  of  functional  testing  with  the  Short  Physical  Performance  Battery  (SPPB) 
and  HRQoL  testing  with  SF-  36  and  Burn  Specific  Health  Scale  (BSHS-B)  will  determine  if  SRT 
improves  functional  performance,  quality  of  life  and  employment  status. 


Publications,  Abstracts,  and  Presentations: 

Our  group  along  with  colleagues  in  Melbourne,  Australia  has  examined  the  reliability  of 
ultrasound  image  assessments  within  the  ICU  population.  This  work  has  now  been  compiled 
into  a  manuscript  and  has  been  submitted  for  publication  (see  appendix). 
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MUSCLE  ULTRASOUND  &  SHORT  PHYSICAL  PERFORMANCE 
BATTERY  (SPPB)  TO  PREDICT  ICU  FUNCTIONAL 
OUTCOMES 

Sanjay  Dhar,  Aarti  Sarwal,  DC  Files,  M  Berry,  J  Hauser,  P  Campbell,  C 
Thompson,  Peter  Morris; 

Introduction:  Difficulties  predicting  ICU  patient  functional  outcomes  include  inability  to 
adequately  assess  the  patient's  true  functional  status  just  prior  to  acute  illness  or  injury.  ICU 
admission  muscle  ultrasound  may  serve  to  provide  characterization  of  pre-ICU  muscle 
architecture  quality.  Ultrasound  image  alterations  such  as  an  increase  in  mean  gray  scale  value 
may  indicate  increased  muscle  echogenicity;  similar  changes  have  been  reported  in  muscular 
dystrophies  and  chronic  inflammatory  myopathies.  Such  a  non-invasive,  safe  and  easily 
obtained  image,  may  provide  investigators  and  clinicians  with  a  novel  tool  to  better  judge  an  ICU 
patient’s  degree  of  pre-morbid  muscle  function.  Such  insight  may  allow  for  better  understanding 
of  the  contribution  of  a  poor  pre-morbid  functional  status  on  post-ICU  functional  status.  This 
independent  baseline  contribution  may  be  measureable  in  the  future  and  be  additive  to  muscle 
dysfunction  attributable  to  the  duration  of  ICU  exposure.  Methods:  16  patients  enrolled  into  the 
NIH  supported  “Standardized  Rehabilitation  Therapy  for  ICU  Patients  with  Acute 
Respiratory  Failure”  study  (5R01NR01 1186-05),  underwent  standard  study  protocol  hospital 
discharge  SPPB  administration.  In  addition,  these  16  underwent  biceps  muscle  ultrasound  at 
study  entry.  B-mode  image  acquisition  was  obtained  using  an  M-turbo  system  (Sonosite)  with  a 
6-15  MHz  transducer.  Biceps  image  obtained  10  cm  prox  to  antecubital  fossa.  Image  J  was 
used  to  obtain  gray  scale  data,  per  our  previous  publication,  Cartwright,  MuscleNerv  ‘13; 

47:255.  Baseline  demographics  and  hosp  days  were  collected.  Pearson  correlation  coefficients 
were  performed  using  biceps  gray  scale  mean  and  SPPB  score.  Results:  Mean  baseline  values 
of  the  16  patients  included  age:  51  years  (12.6  std);  APACHE  III:  70,  (18  std).  All  were 
mechanically  ventilated  at  study  entry.  Baseline  Biceps  gray  scale  mean  54.4  (21.1  std).  The  16 
patients  demonstrated  a  mean  Hosp  duration  of  1 1 .4  days,  (6.6  std).  Hospital  discharge  SPPB 
mean  score  was  4.6  (3.8  std).  [SPPB  scoring  tool  Range  0-12;  12  =  highest  functioning  score]. 
Pearson  correlation  between  baseline  biceps  mean  and  hospital  discharge  SPPB  was  a  (-)0.54, 
p=0.029.  Conclusions:  ICU  admission  images  with  increased  echogenicity  on  muscle 
ultrasound  imaging  as  determined  by  Image  J  analysis  demonstrated  an  association  with  a  low 
SPPB  functional  assessment  at  hospital  discharge.  These  pilot  data  suggest  that  there  may  be 
an  association  between  the  demonstration  of  an  abnormal  baseline  biceps  ultrasound  image 
and  the  patient’s  eventual  hospital  discharge  functional  status  as  determined  by  the  SPPB 
score.  This  pilot  study  holds  potential  to  lend  novel  pre-ICU  muscle  architecture  information  as  it 
pertains  to  assessing  pre-morbid  muscle  architecture’s  role  in  determining  pre-ICU,  baseline 
functionality.  Future  study  of  such  image  assessments  may  allow  investigators  to  become  better 
informed  of  a  patient’s  pre-morbid  functional  status;  lack  of  pre-morbid  functional  status  is  a 
current  barrier  in  determining  what  role  acute  illness  plays  in  ICU  &  Hospital  discharge 
functional  status.  With  further  study,  such  baseline  assessments  may  prove  useful  to  target  ICU 
patients  who  may  especially  benefit  from  a  patient-specific  prescription  of  an  intense  ICU  rehab 
strategy,  due  to  the  ICU  admission  identification  of  pre-ICU  low  functional  status  characteristics 
on  biceps  muscle  ultrasound  imaging. 


EARLY  SERIAL  CHANGES  ON  DIAPHRAGM  MUSCLE  ULTRASOUND  MAY  PREDICT 
DURATION  OF  MECHANICAL  VENTILATION. 

Sarwal,  Aarti;  Bringolf,  Karamie;  Cartwright,  Michael;  Hsu,  Fang-chi;  Berry,  M;  Bowton,  David; 
Dhar,  Sanjay;  Morris,  Peter 

Introduction:  Diaphragm  muscle  weakness  from  disuse  atrophy,  critical  care  weakness  or 
ventilator  induced  muscle  dysfunction  may  contribute  to  weaning  failure  in  patients  on  prolonged 
mechanical  ventilation  (MV).  Difficulty  in  weaning  patients  accounts  for  a  large  proportion  of 
time  spent  in  the  intensive  care  unit  (ICU).  Patients  who  fail  extubation  and  get  re-intubated 
have  higher  mortality  even  after  controlling  for  the  presence  of  co-morbid  conditions  and 
generalized  severity  of  illness.  Many  studies  have  shown  evidence  of  atrophy  and  degeneration 
in  diaphragm  muscle  using  electromyography  and  muscle  biopsy  in  subjects  on  MV.  These 
tests  are  not  feasible  or  practical  for  serial  assessments  of  changes  in  diaphragm  muscle  in 
critically  ill  patients.  Simple,  clinical  tools  are  needed  that  can  identify  these  muscle  changes 
early  on  in  critically  ill  patients  to  better  predict  patients  at  risk  of  extubation  failure  so  we  can 
develop  and  tailor  early,  patient-specific  strategies  for  successful  weaning.  We  performed  this 
pilot  study  to  assess  serial  changes  in  diaphragm  muscles  of  patients  on  MV  and  determine 
whether  these  muscle  changes  predict  extubation  failure  and  length  of  MV  Methods:  We 
recruited  14  mechanically  ventilated  patients  admitted  to  the  NeurolCU  and  Trauma  ICU  at 
Wake  Forest  Baptist  Medical  Center,  Winston  Salem,  NC  over  a  3  month  period.  The  study 
protocol  was  approved  by  the  Institutional  Review  Board  and  informed  consent  was  obtained  on 
all  patients.  Baseline  ultrasound  exam  was  done  to  image  diaphragm  in  right  mid  axillary  line 
within  72  hours  of  ICU  admission.  Serial  exams  were  repeated  daily  until  patients  were 
extubated  or  transferred  out  of  the  ICU,  for  a  maximum  of  7  ultrasound  studies.  Patients  were 
excluded  if  they  had  a  prior  history  of  MV,  chest  tube  or  thoracoabdominal  surgery.  Images 
were  analyzed  using  Image  J  for  diaphragm  muscle  thickness  at  end  expiration  and  echodensity 
using  gray  scale  histogram.  Linear  regression  analysis  was  done  to  determine  if  serial  changes 
in  each  muscle  value  predicted  days  on  MV  after  adjusting  for  age,  Body  Mass  Index  & 
cumulative  fluid  balance.  Results:  14  ventilated  patients  (10  males)  had  mean  age  55.2  +/-  20 
years,  BMI  27.79  +/-  6.22.  Baseline  mean  diaphragm  thickness  within  72  hours  of  ICU 
admission  was  2.70  +/-  0.61  mm  &  did  not  exclusively  predict  the  days  of  MV.  1 1  patients  with 
serial  scans  had  5.73  +/-  4  days  on  MV,  3.45  days  between  1st  and  last  scan  and  fluid  balance 
5.31  L+/-8.8L  on  average.  We  observed  increase  in  diaphragm  thickness  and  decrease  in 
echodensity  over  time.  On  regression  analysis,  serial  change  in  diaphragm  echodensity  was  a 
significant  predictor  of  total  number  of  days  on  MV  after  adjusting  for  age,  BMI,  and  fluid 
balance  on  day  of  last  USG  (p  =0.0285).  Conclusions:  Our  preliminary  data  shows  the 
feasibility  of  performing  quantitative  serial  measurements  on  diaphragm  muscle  ultrasound  in 
critically  ill  patients  and  suggests  that  early  serial  changes  in  the  muscle  parameters  may 
predict  duration  of  MV.  The  early  serial  changes  detected  by  ultrasound  suggest  a  potential 
benefit  of  proactive  early  therapies  designed  to  preserve  respiratory  muscle  architecture  to 
reduce  days  on  MV  and  prevent  extubation  failure.  Small  sample  size  precludes  definite 
interpretation  of  trends  seen  in  our  study.  Larger  studies  are  needed  to  define  parameters  of 
serial  diaphragm  muscle  changes  on  ultrasound  in  patients  on  MV.  Muscle  ultrasound  has 
potential  benefit  as  a  non-invasive  tool  to  assess  serial  changes  in  respiratory  muscles  in  ICU 
patients  on  MV.  It  can  be  used  to  test  optimal  ventilator  modes  and  weaning  strategies  resulting 
in  reduced  ICU  length  of  stay  and  optimize  long  term  outcomes  in  patient  on  MV. 
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RATIONALE:  Early  and  accurate  diagnosis  of  intensive  care  acquired  weakness  is  challenging  in  the  clinical  setting.  Currently  muscle 
strength  testing  is  the  predominant  tool  used  for  diagnosing  this  weakness.  Ultrasonography  is  a  promising  non-volitional  method  for 
tracking  musculoskeletal  changes  from  admission.  No  studies  have  previously  examined  the  relationship  between  ultrasound 
measurements  of  muscle  structure  and  muscle  strength  or  physical  function  in  the  critically  ill  population.  The  aims  were  1)  to  assess  the 
relationship  between  muscle  structure,  muscle  strength,  and  physical  function  in  patients  who  are  critically  ill;  2)  to  assess  difference  in 
muscle  thickness  and  gray  scale  changes  between  baseline  and  ICU  discharge. 

METHODS:  Adults  ventilated  for  >48  hours  were  included  and  underwent  serial  muscle  ultrasound  measurements  for  thickness  and 
grayscale  analysis  of  the  quadriceps  muscle  complex  (rectus  femoris  (RF),  vastus  intermedius  (VI)  and  vastus  lateralis  (VL)  from  admission 
to  ICU  discharge.  Measurements  of  muscle  strength  and  physical  function  were  performed  on  awakening  and  at  ICU  discharge  using 
Medical  Research  Council  sum-score,  physical  function  in  intensive  care  test-scored  and  highest  functional  level  attained.  Statistical 
analysis  included  paired  t-tests  and  Pearson  correlations. 

RESULTS:  Twenty-two  patients  were  included.  Baseline  demographics  are  shown  in  Table  1 .  There  were  no  significant  relationships 
between  baseline  RF  and  VI  thickness  and  muscle  strength  on  awakening  or  at  ICU  discharge.  RF  thickness  at  ICU  discharge  had  a 
moderate  positive  correlation  with  discharge  measures  of  physical  function  (r=0.574,  p=0.020)  and  highest  functional  level  (r— 0.71 1 , 
p=0.002).  There  was  a  moderate  positive  correlation  between  VL  thickness  and  ICU  discharge  muscle  strength  (r=0.508,  p=0.05)  and 
physical  function  (r=0.509,  p=0.044).  Baseline  RF  grayscale  analysis  had  a  moderate  negative  correlation  with  discharge  muscle  strength 
(r=-0.61 1,  p=0,015).  Discharge  measures  of  VI  grayscale  analysis  had  a  moderate  negative  correlation  with  discharge  measures  of  physical 
function  (r=-0,602,  p=0.014)  and  also  diagnosis  of  ICU-acquired  weakness  (r=-0.599,  p=0.0 18).  There  were  significant  differences  in  muscle 
thickness  for  RF  (mean  difference=20%,  p=0.002)  and  VI  muscles  (mean  differenced  1  %,  p—0.01 8)  between  baseline  and  ICU  discharge. 
There  was  also  a  significant  difference  over  time  in  RF  grayscale  standard  deviation  scores  (mean  difference=-6.90,  p=0.020). 
CONCLUSIONS:  Ultrasonography  is  a  promising  bedside  tool  for  detecting  changes  in  muscle  architecture  in  the  critically  ill  population. 
Ultrasonographic  measures  of  muscle  structure,  muscle  strength  and  physical  function  are  moderately  related  in  the  critically  ill 
population. 


Variable 

Age,  years 
Gender,  male 
Diagnosis  Category 

-  Medical 

-  Surgical 


Table  1:  Baseline  demographics 

Mean  (SD)  or  n,  % 

56.2(17.8) 

13(59.1) 

14(63.6) 

8  (36.4) 


Time  from  admission  to  baseline  ultrasound  measures,  hours 

APACHE  II  Score 

Incidence  of  ICU-AW 

MV  time,  hours 

Time  to  awakening,  days 

ICU  LOS,  days 

Hospital  LOS,  days 

Discharge  Destination  -  Home 


51.0  {20.9- 69.9] 1 
23.4(8.1) 

9  (40.9) 

172.1  (112.3-284.1] 
10.0(4.3) 

115  [9.0-  213]' 1 

22.0  [12.8 -4 1.3: 5 
1 1  (50.0) 


1 


Abbreviations:  ICU-AW,  intensive  care  unit  acquired  weakness;  ICU,  intensive  care  unit;  LOS,  length  of  stay;  MV,  mechanical  ventilation. 

t 

Median  [interquartile  range] 
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ABSTRACT 
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23  Objective:  There  is  growing  interest  in  the  use  of  quantitative  high-resolution  neuromuscular 

24  ultrasound  imaging  to  evaluate  skeletal  muscles  in  patients  with  critical  illness.  There  is  currently 

25  considerable  methodological  variability  in  the  measurement  technique  of  quantitative  muscle 

26  analysis.  Reliability  of  muscle  parameters  using  different  measurement  techniques  and  assessor 

27  expertise  level  has  not  been  examined  in  patients  with  critical  illness.  The  primary  objective  of 

28  this  study  was  to  determine  the  inter-observer  reliability  of  quantitative  ultrasound  measurement 

29  analyses  (thickness  and  echogenicity)  between  assessors  of  different  expertise  levels  and  using 

30  different  techniques  of  selecting  region  of  interest. 

31  Materials  and  Methods:  Cross-sectional  observational  study  in  a  Neurocritical  care  and  a 

32  mixed  surgical-medical  intensive  care  unit  from  two  tertiary  referral  hospitals. 

33  Results:  Twenty  diaphragm  and  20  quadriceps  images  were  evaluated.  Images  were  obtained 

34  using  standardized  imaging  acquisition  techniques.  Quantitative  ultrasound  measurements 

35  included  muscle  thickness  and  echogenicity  analysis  (either  by  trace  or  square  techniques).  All 

36  images  were  analyzed  twice  independently  by  four  assessors  of  differing  expertise  levels. 

37  Excellent  inter-observer  reliability  was  obtained  for  all  measurement  techniques  regardless  of 

38  expertise  level  (Intra-class  Correlation  Coefficient  (ICC)  >0.75  for  all  comparisons).  There  was 

39  less  variability  between  assessors  for  echogenicity  values  when  square  technique  was  used  for 

40  quadriceps  muscle  and  the  trace  technique  for  the  diaphragm. 

41  Conclusions:  Excellent  inter-observer  reliability  exists  regardless  of  expertise  level  for 
quantitative  analysis  of  muscle  parameters  on  ultrasound  in  the  critically  ill  population.  Based  on 


42 
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43  these  findings,  it  is  recommended  that  echogenicity  analysis  be  performed  using  square 

44  technique  for  quadriceps  and  trace  technique  for  diaphragm. 

45 

46  Key  words:  critical  care  weakness;  grayscale  analysis;  muscle,  ultrasound 
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47  INTRODUCTION 

48  Traditional  techniques  of  muscle  evaluation  including  manual  muscle  testing, 

49  electromyography,  nerve  conduction  studies,  and  muscle  biopsy  have  proven  challenging  in  the 

50  routine,  clinical,  and  research  studies  of  intensive  care  unit-acquired  weakness  (ICU-AW) 

51  because  of  the  need  for  trained  staff,  patient  cooperation,  or  invasive  nature  of  the  study.1  ’ 

52  Muscle  biopsy  studies  have  shown  that  ultrastructural  changes  occur  in  skeletal  muscle 

53  echotexture  in  ICU-AW.4  There  is  growing  interest  in  the  development  of  a  noninvasive  imaging 

54  tool  for  muscle  function  and  structure  with  high  clinical  utility  to  evaluate  these  changes  in  the 

55  intensive  care  unit  (ICU)  setting. 

56  The  evolution  of  high  resolution  ultrasound  imaging  of  the  muscle  has  allowed  us  to  use 

57  quantitative  muscle  parameters  to  distinguish  muscle  pathologies  such  as  atrophy,  dystrophy,  and 

58  sarcopenia.5  6  Quantitative  muscle  parameters  on  B-mode  ultrasound  imaging  -  muscle  thickness 

59  and  gray  scale  echogenicity  -  have  been  proposed  to  reflect  changes  in  muscle  echotexture.  s 

60  Muscle  thickness  on  ultrasound  images  has  been  validated  against  other  imaging  modalities  such 

61  as  computed  tomography  and  magnetic  resonance  imaging  as  well  as  direct  measurements  on 

62  dissected  cadavers.9'11  Mean  echogenicity  value  of  a  muscle  is  calculated  by  performing 

63  grayscale  analysis  of  image  pixels  using  the  histogram  feature  of  image  processing  software  such 

64  as  Image  .1  or  Photoshop©  (Figure  1).  All  the  pixels  in  the  selected  area  of  the  muscle  are 

65  categorized  on  a  gray  scale  configuration.  This  has  been  shown  to  correlate  with  muscle 

g  p 

66  pathology  on  biopsy, "  “  Normative  values  of  both  thickness  and  echogenicity  have  been  reported 
in  healthy  volunteers  and  neuromuscular  disease  states. 
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68  Recently,  muscle  ultrasound  imaging  has  attracted  significant  attention  in  assessing 

69  skeletal  muscle  changes  seen  in  critical  illness,  sepsis,  and  mechanical  ventilation.4'16  Ultrasound 

70  is  non-invasive,  safe  and  readily  available  in  the  ICU  with  no  risk  of  radiation;  hence,  it  is  an 

71  ideal  modality  to  study  ICU-AW,  Reliability  of  ultrasound  image  acquisition  by  operators  of 

72  various  experience  levels  has  been  shown  to  be  high  but  we  do  not  know  if  experience  plays  a 

73  role  in  facilitating  more  reliable  image  analysis  if  a  standardized  protocol  of  image  analysis  is 

74  used. 1  14  There  is  also  considerable  methodological  variability  in  quantitative  muscle  analysis  in 

75  this  emerging  area.  Most  of  these  reliability  studies  have  been  performed  in  images  obtained 

76  from  healthy  volunteers  or  patients  with  neuromuscular  diseases  in  outpatient  settings.20  There  is 

77  an  urgent  need  to  evaluate  the  reliability  and  differences  in  quantitative  ultrasonography 

78  measurements  using  different  techniques  to  determine  if  differences  exist  in  results  obtained  by 

79  different  assessor  expertise  levels  in  the  ICU  setting. 

80  This  is  the  first  study  to  examine  the  inter-observer  reliability  of  quantitative  ultrasound 

81  image  analysis  in  patients  in  the  ICU  setting.  The  primary  objective  of  this  study  was  to 

82  determine  the  inter-observer  reliability  of  quantitative  ultrasound  measures  of  thickness  and 

83  echogenicity  in  both  the  diaphragm  and  quadriceps  muscles  for  novice  and  experienced 

84  operators.  The  secondary  objective  was  to  determine  if  there  was  a  difference  between 

85  quantitative  echogenicity  techniques  used.  Initial  results  of  this  analysis  were  presented  at  the 

86  Society  of  Critical  Care  Medicine  Congress,  San  Francisco,  CA  in  January  2014T  The 

87  Guidelines  for  Reporting  Reliability  and  Agreement  Studies  were  followed  for  preparation  of  the 

TJ  IT 

88  manuscript,"""*' 
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90  MATERIALS  AND  METHODS 

91  Study  design  and  setting 

92  This  was  a  cross-sectional  observational  study  examining  reliability  of  muscle  ultrasound 

93  imaging  analysis  in  previously  acquired  muscle  images  from  critically  ill  patients  admitted  to  the 

94  ICU  in  two  different  hospital  settings.  Diaphragm  images  were  acquired  in  patients  admitted  to 

95  the  Neurocritical  care  unit  at  Wake  Forest  School  of  Medicine,  Winston-Salem,  NC.  USA. 

96  Quadriceps  images  were  acquired  in  patients  admitted  to  a  mixed  surgical-medical  ICU  at  Austin 

97  Health,  Melbourne,  Australia.  Images  were  acquired  as  a  part  of  ongoing  clinical  studies  at  both 

98  centers  with  relevant  approval  by  the  local  institutional  review  board  (IRB).  Written  informed 

99  consent  was  obtained  for  images  acquired  at  Wake  Forest  per  IRB  requirements.  Human 

100  Research  Ethics  Committee  at  Austin  Health  waived  the  need  for  informed  consent. 

101 

102  Image  acquisition 

103  All  ultrasound  images  were  obtained  with  a  standardized  protocol  of  transducer 

104  placement,  anatomic  landmarks,  and  patient  position  for  acquisition.  The  same  experienced 

105  assessor  acquired  alt  images  included  for  analysis  (diaphragm  -  AS;  quadriceps  -  SMP)  with 

106  depth,  gain,  compression  and  sonographic  settings  kept  constant  between  subjects.  Rectus 

107  femoris  images  were  obtained  using  an  8.5-MHz  linear-array  transducer  (Voluson  E  BT09 

108  Ultrasound,  GE  Healthcare,  Yokogawa  Medical  Systems  Ltd.,  Japan)  at  5  cm  depth  on  the  right 

109  lower  limb.  The  transducer  was  placed  perpendicular  to  the  long  axis  of  the  thigh  on  its  anterior 

110  surface,  two-thirds  of  the  distance  from  the  anterior  superior  iliac  spine  to  the  superior  patellar 
bonier.  The  specific  orientation  of  the  probe  was  chosen  as  this  was  the  only  orientation  that 
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112  could  be  clinically  the  most-  be  standardized  without  needing  additional  equipment  in  the  critical 

113  care  setting  .Also,  our  previous  work  in  critically  ill  patients  suggested  that  the  cross-sectional 

114  ultrasonographic  view  might  be  more  sensitive  to  changes  in  muscle  echotexture  in  ICU 

115  population.1  Imaging  was  completed  in  supine  position  with  the  leg  supported  in  passive 

116  extension  and  neutral  rotation.1,24  Diaphragm  images  were  obtained  on  the  right  side  via  an 

117  intercostal  approach  using  a  6-15  MHz  Transducer  (M-Turbo  Ultrasound  System,  SonoSite,  Inc., 

118  USA)  placed  in  the  sagittal  plane  with  patients  in  supine  position  and  the  head  of  bed  elevated  at 

119  30  degrees.  Images  were  captured  in  the  right  mid-axillary  line  to  obtain  a  sagittal  image  of 

120  diaphragm  muscle  at  the  zone  of  apposition  at  end  of  expiration  with  the  transducer  always 

121  perpendicular  to  the  diaphragm  muscle.25 

122 

123  Study  procedures 

124  Assessors 

125  Four  assessors  were  involved  in  this  study.  Two  assessors  were  experienced  ultrasonographers 

126  (AS-neurocritical  care  physician  and  SMP-Senior  ICU  Physiotherapist)  with  more  than  one  year 

127  of  experience  in  muscle  ultrasound  acquisition  and  quantitative  muscle  imaging  analysis. 

128  Currently,  there  is  no  formal  specified  credentialing  or  certification  process  for  muscle 

129  ultrasonography.  Our  assessors  were  considered  experienced  based  on  their  background  formal 

130  training  in  neuromuscular  physiology,  muscle  ultrasound  techniques  and  established  clinical  and 

131  research  ex perience  of  acquiring  and  analyzing  muscle  ultrasound  images  using  Image  J . ' 

132  The  other  two  assessors,  considered  novice  users  (ML  and  NJ),  were  exercise  physiology 

133  students  with  knowledge  of  muscle  anatomy  but  no  prior  ultrasound  exposure  to  ultrasonography 
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134  or  image  analysis  software.  Both  received  a  total  of  three  hours  of  training  over  the  course  of  two 

135  sessions  on  ultrasound  and  quantitative  muscle  analysis  using  Image  J  software,  a  public  domain, 

136  Java-based  image  processing  program  developed  at  the  National  Institute  of  Health.  ‘  The 

137  training  was  done  by  one  of  the  experienced  assessors  (AS)  anti  included  demonstration  of 

138  ultrasound  image  acquisition  with  hands  on  training  using  a  volunteer  to  familiarize  them  with 

139  muscle  anatomy  on  ultrasonography.  Then  they  were  given  instructions  on  identifying  anatomy 

140  and  artifacts  on  ultrasound  images  and  on  using  Image  J.  A  written  handout  was  given  that 

141  outlined  muscle  anatomy,  major  artifacts,  Image  J  troubleshooting  and  detailed  instructions  on 

142  measuring  each  parameter  with  pictorial  examples.  They  were  given  a  series  of  sample  images  to 

143  analyze  at  home.  Their  competency  was  tested  by  having  them  demonstrate  each  measurement  to 

144  the  instructor  for  each  method  multiple  times  at  the  end  of  session  1 ,  beginning  and  end  of 

145  session  2. 

146  For  the  actual  study,  the  images  were  de-identified  by  a  neutral  person  (MJB)  and  then 

147  randomly  assigned  to  each  assessor  for  image  analysis.  The  assessors  were  blinded  in  between 

148  the  analysis  by  time  delay  of  1  month. 

149 

150  Image  analysis 

151  Twenty  diaphragm  and  20  quadriceps  images  obtained  in  critically  ill  patients  during 

152  different  stages  of  ICU  stay  were  randomly  selected  for  quantitative  analysis.  Operator  selecting 

153  images  was  blinded  to  clinical  characteristics  of  patients  from  which  these  images  were  obtained. 

154  These  images  were  reviewed  in  a  random  order  by  each  rater  following  a  standardized  protocol 

155  described  below.  Repeat  analysis  was  done  by  ail  assessors  blinded  to  previous  results.  All  four 
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156  assessors  performed  measurements  independently  and  had  no  access  to  the  results  from  the  other 

157  assessors  or  their  own  previous  assessments  thereby  ensuring  blinding  of  results  from  one 

158  another.  All  assessors  repeated  the  echogenicity,  and  thickness  measurements  twice  and  the 

159  mean  value  was  used  in  statistical  analyses.  All  images  were  analyzed  with  Image  J  using  a 

160  standardized  protocol  for  measurement  of  thickness  and  echogenicity  for  both  diaphragm  and 

38 

161  quadriceps  musculature. 

162 

163  Thickness 

164  Muscle  thickness  was  measured  as  maximum  distance  between  the  pleural  and  peritoneal 

165  margins  of  the  diaphragm  muscle.  35  Quadriceps  thickness  was  measured  as  the  maximum 

166  thickness  of  rectus  femoris/vastus  intermedins  complex  from  femur  to  subcutaneous  tissue. 1 

167 

168  Echogenicity 

169  Muscle  echogenicity  was  measured  using  the  gray  scale  analysis  histogram  feature  on 

170  Image  J.  Mean  echogenicity  was  measured  in  an  area  of  the  muscle  outlined  using  the  “trace” 

171  method  as  well  as  the  “square  “technique  (Figure  1).  Using  the  trace  method,  the  assessor 

172  highlighted  all  visible  muscle  area  excluding  artifacts  and  analyzed  the  enclosed  area  for 

173  echogenicity  analysis. For  the  square  technique,  a  standard  square  area  (20x20  pixels  for 

174  diaphragm  and  100x100  pixels  for  rectus  femoris)  was  chosen  within  the  muscle  margins  that 

175  be-a  represented  the  muscle  bulk.'  Pixel  length  was  used  for  defining  the  area  due  to  different 

176  pixel  density  at  various  depths  used  to  produce  ultrasound  images.  For  the  diaphragm, 
echogenicity  was  measured  on  the  muscular  portion  beyond  aponeurosis  whenever  possible. 


177 
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178  When  analyzing  echogenicity  of  quadriceps,  only  rectus  femoris  was  used  for  echogenicity 

179  analysis  when  anatomically  visible  otherwise  the  representative  area  of  the  rectus  femoris/vastus 

180  intermedius  complex  was  chosen.  For  the  square  method,  if  the  defined  pixel  measures  (20x20 

181  for  diaphragm  and  100x100  for  rectus  femoris)  were  found  to  be  larger  than  cross  section  of  the 

182  muscle,  the  largest  square  that  stayed  within  the  anatomic  boundaries  of  the  muscle  was  chosen. 

183 

184  Statistical  analysis 

185  All  statistical, analyses  were  performed  using  SPSS  for  Macintosh  Statistical  software 

186  package  (Mac  SPSS  Version  21,  IBM,  New  York,  NY.  USA).  One  Sample  Kolmogorov- 

187  Smirnov  test  was  used  to  test  for  normality  of  the  data.  Mean  (±SD)  of  mean  measures  for 

188  muscle  thickness  and  echogenicity  for  the  quadriceps  and  diaphragm  muscles  for  the  four  raters 

189  were  calculated.  One  way  ANOVA  was  performed  to  compare  differences  among  the  mean 

190  values  obtained  for  each  muscle  parameter  by  different  raters  (Tables  1  and  2). 

191  Intra-Class  Correlation  Coefficient  (ICC)  values  were  calculated  using  the  mean  of 

192  measures  and  the  ICC  model  (2.1)  two-way  random  effects  for  inter-observer  reliability  (Table 

193  3).  An  ICC  is  measured  on  a  scale  of  0  to  1;  I  represents  perfect  reliability  w  ith  no  measurement 

'YX 

194  error,  whereas  0  indicates  no  association.  "  An  ICC  >0.75  is  considered  to  have  good  to  excellent 

195  reliability.11  *!  Paired  t-tests  were  performed  to  determine  mean  differences  and  95%  confidence 

196  between  mean  echogenicity  using  square  versus  trace  methods.  The  level  of  significance  was  set 

197  at  0.05.  Bland- Altman  (BA)  plots  were  examined  to  provide  a  visual  representation  of  the 
agreement  between  assessors  for  thickness  and  echogenicity  measurements  for  both  the 
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199  diaphragm  and  quadriceps  muscles  and  to  examine  if  there  is  a  systematic  error  present  (Figure 

200  2). 

201  Sample  Size  Calculation 

202  To  look  for  a  minimum  ICC  value  of  0.75  of  inter-observer  reliability,  we  estimated  a 

203  priori  that  a  minimum  of  12  participants  were  required  for  each  muscle  analyzed  to  achieve  80% 

204  power  with  significance  level  set  at  0.05.  To  ensure  that  enough  images  were  available  for 

205  statistical  analysis,  we  included  20  diaphragm  and  20  quadriceps  images  in  this  study. 10,42 

206 
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207  RESULTS 

208  Mean  (±SD)  of  mean  measures  for  muscle  thickness  and  echogenicity  for  the  diaphragm 

209  and  quadriceps  muscles  for  the  four  raters  are  shown  in  Tables  1  and  2.  One  sample 

210  Kolmogorov-Smimov  test  was  used  to  test  for  normality  of  the  data  and  no  significant 

211  differences  were  present  between  the  observed  distributions  and  normal  distributions.  No 

212  significant  differences  were  found  among  the  four  raters  in  diaphragm  muscle  thickness  or 

213  echogenicity  as  determined  by  the  trace  or  square  method  or  in  quadriceps  muscle  thickness  or 

214  echogenicity  as  determined  by  the  trace  or  square  method. 

215  Inter-observer  reliability  results  between  the  two  novice  raters  and  inter-observer 

216  reliability  results  between  the  two  experienced  raters  are  shown  (Table  3).  Overall,  there  was 

217  very  good  inter-observer  reliability  between  all  assessors  for  measurement  of  muscle  thickness 

218  and  echogenicity  regardless  of  technique  (trace  or  square)  for  both  diaphragm  and  quadriceps 

219  muscles  with  ICC  values  ranging  from  0.84  to  0.99.  Experienced  raters  showed  similar  ICCs  for 

220  muscle  thickness  and  echogenicity  for  the  quadriceps  and  diaphragm  muscles.  Diaphragm 

221  thickness  showed  the  least  agreement  and  consistency  of  all  muscle  parameters  between  the 

222  experienced  raters,  although  the  correlation  values  were  still  high.  For  the  novice  raters,  overall 

223  ICCs  for  thickness  and  echogenicity  via  the  square  method  were  lower  in  the  diaphragm 

224  compared  to  the  quadriceps.  Reliability  of  quadriceps  thickness  and  echogenicity  obtained  from 

225  the  square  method  was  excellent  (>0.90)  for  both  the  novice  and  experienced  raters.  Between  the 

226  two  nov  ice  assessors,  the  trace  method  for  echogenicity  analysis  for  quadriceps  muscles  showed 

227  wider  limits  of  agreements,  which  were  statistically  significant  (p<0.01)  with  a  mean  difference 
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229  When  comparing  the  two  different  methods  of  echogenicity  analyses,  there  was  a 

230  significant  difference  in  mean  echogenicity  values  between  the  square  and  trace  method  for 

231  measurement  of  echogenicity  in  each  muscle.  For  the  quadriceps,  the  mean  difference  between 

232  square  and  trace  was  9.26  (95%  Cl:  5.73-12.79:  p<0.001  and  for  the  diaphragm,  the  mean 

233  difference  between  square  and  trace  was  1. 14  (95%  Cl:  0.23-2.05;  p=0.02). 

234  Bland-Altman  plots  for  agreement  between  all  assessors  for  thickness  and  echogenicity 

235  (square  and  trace)  for  diaphragm  and  quadriceps  muscles  are  shown  in  Figure  2.  Bland-Altman 

236  analysis  demonstrated  wider  limits  of  agreements  in  novice  raters  for  all  quantitative 

237  measurements  -  thickness  and  echogenicity,  for  both  diaphragm  and  quadriceps  muscles  when 

238  compared  to  experienced  assessors  (Figure  2). 


239 


14 


240  DISCUSSION 

241  Our  study  shows  that  quantitative  analysis  of  muscle  parameters  on  ultrasound  images 

242  acquired  using  a  clinically  reproducible  standardized  image  acquisition  and  image  analysis 

243  protocol  is  reliable  and  feasible  in  critically  ill  patients.  The  findings  support  further  use  and 

244  research  related  to  standardized  quantitative  ultrasound  analysis  in  the  critical  care  setting. 

245  Many  previous  studies  have  shown  inter-observer  and  intra-observer  reliability  for 

246  acquisition  of  muscle  ultrasound  images  in  healthy  volunteers.23-43  4<1  A  recent  study  evaluated 

247  the  inter-observer  reliability  of  gray  scale  density  in  large  peripheral  limb  muscles  of  19  boys 

248  with  Duchene  muscular  dystrophy  and  21  healthy  control  boys  and  found  high  reliability  with 

249  similar  ICCs.ls  We  undertook  this  study  to  evaluate  reliability  of  quantitative  neuromuscular 

250  ultrasound  imaging  in  the  critically  ill  population  that  may  have  different  and  unique  muscle 

251  characteristics.  Diaphragm  and  quadriceps  muscle  were  chosen  because  they  have  significant 

252  differences  in  anatomy  and  acquisition  characteristics.  The  diaphragm  muscle  is  relatively  thin 

253  (mean  reported  thickness  3.3  mm)  and  challenging  to  identify  especially  on  post-acquisition 

254  review  of  static  B-mode  imaging.25,4  In  comparison,  the  quadriceps  is  a  relatively  thick  muscle 

t  o  . 

255  (mean  reported  thickness  44  mm)  and  thus  potentially  easier  to  image  and  identify.  Ultrasound 

256  image  analysis  depends  on  knowledge  of  anatomy  as  well  as  a  working  understanding  of 

257  ultrasound  artifacts.  This  study  was  designed  to  assess  if  analysts  with  variable  training 

258  background  and  knowledge  of  anatomy  and  ultrasound  were  able  to  measure  quantitative 

259  ultrasound  parameters  with  a  certain  degree  of  consistency  and  agreement  since  prev  a  lent 

260  research  and  clinical  studies  have  variable  training  and  backgrounds  of  personnel  performing 

261  ultrasonography.  Observer  dependency  has  been  criticized  .us  major  factor  impeding  widespread 
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262  use  of  ultrasonography  in  clinical  and  research  settings.  This  study  assessed  the  reliability  of 

263  observations  made  by  novice  users  since  many  clinical  research  designs  involve  training  of 

264  personnel  with  limited  exposure  or  experience  in  muscle  ultrasonography. 

265  Our  study  design  has  a  fundamental  difference  from  published  protocols  on  measuring 

266  echogenicity  that  focus  on  reporting  accuracy  of  echogenicity.  We  formulated  the  design  of  the 

267  study  to  allow  easy  reproducibility  of  image  acquisition  and  analysis  protocols  in  further 

268  research  and  clinical  studies.  Evidence  suggests  that  probe  orientation  needs  to  be  perpendicular 

269  to  the  muscle  fibers  to  have  the  greatest  echogenicity  and  a  slight  tilt  or  pressure  can  change  the 

270  echogenicity  significantly.10,48'50  The  published  protocols  use  or  suggest  use  of  a  device  or  a 

271  robot  arm  that  ensures  uniform  force  and  angle  targets  during  the  time  of  image  acquisition  once 

272  fiber  directions  is  ascertained  with  visualization.51  WTiilc  we  did  consider  anisotropy  and 

273  possibility  of  using  such  a  device,  this  device  is  not  a  routine  part  of  clinical  ultrasonography  and 

274  its  requirement  during  imaging  may  limit  the  widespread  clinical  use  of  quantitative 

275  ultrasonography  in  assessing  muscle  pathology.  It  is  also  very  difficult  in  the  ICU  to  standardize 

276  the  probe  directions  to  be  perpendicular  to  the  fibers  as  patients  may  have  confounding  factors 

277  like  atrophy,  edema,  invasive  devices,  or  pathology  that  may  impair  fiber  visualization.  Our  goal 

278  was  to  keep  the  image  acquisition  protocol  reproducible  and  practically  useful  in  clinical  settings 

279  so  that  further  studies  can  investigate  the  utility  of  muscle  echogenicity  in  assessing  muscle 

280  weakness  in  the  critical  care  settings  and  investigate  its  correlation  to  clinical  outcomes,  Many 

281  authors  hu\e  highlighted  the  need  for  validation  and  reliability  studies  in  critically  ill  patients  and 

282  our  study  is  first  in  series  of  such  an  attempt.  Use  of  stringent  image  acquisition  criteria  that 
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may  be  challenging  to  reproduce  in  routine  clinical  settings  would  hamper  and  restrict  further 

284  investigations  and  widespread  clinical  use  of  muscle  echogenicity  parameter. 

285  Currently  echogenicity  measurements  are  not  available  as  part  of  standard 

286  ultrasonography  software.  Computer  assisted  measurements  have  to  be  done  post  acquisition 

287  using  image  analysis  software  to  measure  gray  scale  density  like  Adobe  Photoshop©  and  Image 

288  J.'8  We  chose  ultrasonography  machines  most  commonly  used  in  routine  clinical  settings  in  the 

289  critical  care  units  .The  choice  of  an  image  analysis  software  was  based  on  the  fact  it  was 

290  designed  by  NIH  for  scientific  work  ,is  available  for  free  download  along  with  easy  instructions 

291  on  use  and  allows  batch  processing  hence  can  analyze  a  batch  of  images  quickly  .  These  features 

292  allow  feasibility  of  clinical  use  until  inbuilt  ultrasonographic  software  becomes  available  for 

293  such  measurements.  By  showing  reliability  of  measurements  under  clinically  reproducible 

294  settings  with  novice  users,  our  hope  is  to  allow  larger  investigational  studies  that  focus  on 

295  finding  clinically  useful  markers  of  muscle  pathology  that  can  be  used  to  guide  diagnosis  or 

296  interventions.  Muscle  ultrasonography  has  a  wide  range  of  applicability  in  the  critical  care 

297  settings  due  to  its  portable  non  invasive  nature.5 '  61  Muscle  echogenicity  is  being  investigated  for 

298  use  to  assess  change  in  a  patient’s  nutritional  status  that  be  a  target  of  nutritional  therapies.  ’  * 

299  If  a  clinical  protocol  using  muscle  echogenicity  can  identify  patients  at  higher  risk  of  muscle 

300  changes  upon  admission  or  onset  of  weakness  during  ICU  stay,  interventions  like  early  and  more 

301  aggressive  physical  therapy ,  nutritional  therapies  or  functional  muscle  stimulation  have  a 

302  potential  of  reducing  the  extent  of  weakness  and  ultimately  reducing  length  of  stay  and 
improving  functional  outcomes.24"56'37*6'5  In  addition,  diaphragm  muscle  ultrasonography  has 
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304  potential  of  identifying  patients  at  risk  of  extubation  failure  and  such  patients  can  be  targeted  for 

305  specific  weaning  protocols  that  strengthen  respiratory  muscle.  1  M  0 

306  Overall,  excellent  correlations  between  novice  and  experienced  analysts  for  all  ultrasound 

307  measures  in  our  study  reflects  that  quantitative  muscle  analysis  can  be  learned  with  focused 

308  training  on  muscle  anatomy  and  ultrasound  techniques  despite  having  no  prior  training  in 

309  ultrasonography  or  computer  assisted  image  analysis  negating  the  widely  held  belief  that 

310  learning  ultrasonography  has  a  steep  learning  curve  that  is  recently  being  challenged.18 

311  Thickness  values  had  high  reproducibility  overall  for  both  muscles.  Diaphragm  thickness  showed 

312  the  least  agreement  and  consistency  due  to  the  challenge  of  identifying  it  post  processing.  The 

313  muscle  is  very  small  and  may  be  hard  to  distinguish  individually  from  the  intercostal  muscle. 

314  Thickness  measurement  is  also  challenged  by  layers  of  high  echogenicity  produced  by 

315  intertwining  layers  of  diaphragm  tendons  that  may  confuse  the  observer  about  the  actual  span  of 

316  the  diaphragm  thickness.35  Reliability  of  quantitative  echogenicity  analysis  has  not  been 

317  previously  described  for  the  diaphragm  muscle.  In  our  study,  the  best  inter-observer  reliability  of 

318  mean  echogenicity  values  was  obtained  using  the  trace  technique  for  the  diaphragm.  Use  of  the 

319  square  method  for  diaphragm  analyses  may  have  made  it  more  difficult  to  identify  the  muscular 

320  portion  of  the  diaphragm  and  hence  not  as  reliable.  However,  the  square  technique  had  more 

321  consistent  results  for  the  quadriceps  muscle  amongst  both  novice  and  experienced  users  in  our 

322  cohort.  Part  of  this  discrepancy  might  be  a  result  of  the  variability  generated  as  the  assessor  was 

323  arbitrarily  able  to  choose  to  include  the  rectus  femoris/ vastus  intermedins  complex  when 

324  anatomy  of  the  rectus  femoris  was  not  clearly  defined.  This  may  include  the  inter  muscular 
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325  connective  tissue,  fascia  and  blood  vessels.  Restricting  to  a  predefined  square  for  analysis 

326  focussed  most  area  on  muscular  bulk  that  reflected  in  higher  consistency. 

327  Mean  values  of  thickness  and  echogenicity  on  our  patients  varied  slightly  from  normative 

328  values  reported  in  healthy  volunteers  emphasizing  the  need  to  assess  normative  ranges  for 

329  quantitative  ultrasound  parameters  in  critically  ill  patients  who  might  have  varied  pre-existing 

330  level  of  fitness  medical  comorbidity  or  chronic  illness  all  of  which  affect  baseline  muscle 

331  parameters.13  Mean  thickness  values  for  diaphragm  at  end  expiration  in  our  cohort  ranged  from 

332  2. 2-2. 7  mm.  Mean  diaphragm  thickness  has  been  reported  in  literature  to  be  3.3  mm  with  1.5  mm 

333  as  lower  limit  of  normal  resting  thickness.4  These  values  are  reported  in  outpatient  setting 

334  evaluations  in  normal  subjects  done  at  standardized  lung  volumes.  Most  critically  ill  patients  are 

335  unable  to  cooperate  to  allow  measurements  at  a  set  lung  volume.  Mean  quadriceps  thickness 

336  reported  in  normal,  healthy  volunteers  ranges  between  36-47  mm  while  our  population  had  mean 

337  thickness  between  17.1-8.2  mm."  Our  images  were  obtained  in  critically  ill  patients  who  might 

338  have  had  some  degree  of  muscle  weakness  and  atrophy  attributed  to  comorbidities  like 

339  congestive  heart  failure,  chronic  obstructive  pulmonary  disease,  or  critical  care  weakness.  This 

340  could  explain  the  thinner  quadriceps  in  our  cohort. 

341  Our  study  has  several  limitations.  We  have  limited  data  on  critically  ill  patients  on 

342  clinically  significant  differences  between  normal  and  abnormal  muscle  thickness  and 

343  echogenicity  values.  Our  study  also  lacks  correlations  of  quantitative  muscle  parameters  to 

344  clinical  markers  of  muscle  strength  and  structure.  The  clinical  significance  of  the  limits  of 

345  agreement  values  seen  for  muscle  parameters  in  our  study  also  needs  to  be  explored.  One  study 
analyzing  seven  intubated  patients  showed  decrease  in  diaphragm  thickness  by  6%  per  day  of 
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mechanical  ventilation.68  Whether  such  small  changes  can  be  reliably  detected  given  variability 

348  of  diaphragm  measurements  needs  to  be  investigated. 

349 

350  Conclusions 

351  Quantitative  muscle  analysis  on  ultrasound  images  has  excellent  inter-observer  reliability 

352  with  agreement  and  consistency  amongst  experienced  analysts  and  novice  users  after  structured 

353  formal  training.  While  we  reiterate  the  need  for  a  standardized  protocol  for  image  acquisition  and 

354  analyses,  our  results  suggest  that  measures  of  echotexture  using  gray  scale  analysis  might  not  be 

355  interchangeable  between  square  and  trace  techniques.  We  suggest  that  studies  using  quantitative 

356  ultrasound  should  report  on  the  exact  methodology  (square  or  trace)  utilized  in  muscle  analysis 

357  as  well  as  expertise  and  number  of  different  assessors  used.  Future  research  needs  to  be  focussed 

358  on  correlating  clinical  measures  of  muscle  function  to  quantitative  muscle  parameters  such  as 

359  thickness  and  echogenicity  values.  High  resolution  quantitative  muscle  ultrasound  holds  great 

360  potential  in  clinical  and  research  evaluation  of  muscle  changes  in  the  ICU  setting. 
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Table  1.  Quantitative  Parameters  for  Quadriceps  Muscle.  Each  box  represents  mean  of  scores 
(Standard  Deviation) 
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Rater  A 

Rater  B 

Rater  C 

Rater  I) 

p-value 

Muscle 

Thickness 

Square 

1.82(0.75) 

1.80  (0.70) 

1.80  (0.80) 

1.71  (0.68) 

0.96 

Echogenicity 

77.0(21.2) 

74.5  (20.8) 

79.30  (24.8) 

79.9  (24.5) 

0.87 

Trace 

Echogenicity 

65.0(17.1) 

71.0  (20.1) 

68.4(17.2) 

69.4(19.4) 

0.77 

A  between  measures  ANOVA  was  used  to  test  for  significant  differences  among  the  4  raters.  No 


significant  differences  were  found  among  (between)  the  4  raters  for  quadriceps  muscle  thickness, 
square  echogenicity  or  trace  echogenicity. 
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Table  2:  Quantitative  Parameters  for  Diaphragm  Muscle* 


Rater  A 

Rater  B 

Rater  C 

Rater  D 

p-value 

Muscle 

Thickness 

0.22  (0.08) 

0.23  (0.08) 

0.26  (0.08) 

0.25  (0.08) 

0.54 

Square 

Echogenicity 

43.6(13.4) 

45.2(14.4) 

48.8  (15.4) 

48.7  (13.8) 

0.57 

Trace 

Echogenicity 

43.4(13.5) 

44.9(14.7) 

46.9(13.6) 

46.7  (14.3) 

0.86 

*  Each  box  represents  mean  of  scores  (Standard  Deviation). 


A  between  measures  ANOVA  was  used  to  test  for  significant  differences  among  the  4  raters.  No 
significant  differences  were  found  among  (between)  the  4  raters  for  diaphragm  muscle  thickness. 


square  echogenicity  or  trace  echogenicity. 
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Table  3:  Inter-Obsever  Reliability  Assessment 


Novice  Inter-observer  Reliability  Experienced  Inter-observer  Reliability 
ICC  (95%  Cl)  ICC  (95%  Cl) 


Agreement  Consistency  Agreement  Consistency 


Quadriceps 

Muscle  thickness  0.968(0.921-0.987)  0.966(0.917-0.987)  0.913(0.796-0.965)  0.917(0.802-0.966) 


Square 

echogenicity 


0.902(0.774-0.960)  0.904(0.775-0.961)  0.993  (0.984-0.997)  0.993  (0.983-0.997) 


Trace 

0.844(0.537-0.943)  0.883  (0.729-0.952)  0.973  (0.935-0.989)  0.973  (0.934-0.989) 

echogenicity 

Diaphragm 


Muscle  thickness  0.851(0.665-0.938)  0.859(0.678-0.942)  0.868  (0.683-0.940)  0.882(0.727-0.952) 


Square 

echogenicity 

Trace 

echogenicity 


0.851(0.667-0.938)  0.851  (0.661-0.938)  0.964(0.911-0.986)  0.962(0.907-0.955) 


0.899(0.767-0.959)  0.899(0.764-0.959)  0.984(0.959-0.993)  0.983  (0.958-0.993) 


ICC,  intra-class  correlation  coefficient;  95%  Cl,  95  percent  confidence  intervals 
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Figure  Legends 

Figure  1 :  Echogenicity  analysis  of  the  diaphragm  muscle  using  (upper  left)  a  predefined 

square  area  of  20x20  pixels  (square  technique)  and  (upper  right)  tracing  the 
anatomical  boundary  of  the  muscle  (trace  technique).  Echogenicity  analysis  of 
rectus  femoris  muscle  using  (lower  left)  a  predefined  square  area  of  100x100 
pixels  (square  technique)  and  (lower  right)  tracing  the  anatomical  boundary  of  the 
muscle  (trace  technique). 

Figure  2:  Bland-Altman  analysis  plots  for  agreement  between  assessors  for  diaphragm  and 

quadriceps  muscle.  The  x-axis  shows  the  mean  of  two  values  as  assessed  by  each 
assessor.  The  y-axis  shows  the  difference  between  means  of  these  values  for  each 
assessor.  The  three  horizontal  lines  parallel  to  x-axis  represent  the  length  of 
agreement  (LOA+),  the  mean  difference  and  LOA-  for  that  muscle  parameter. 


